🕷️️ Job Radar • SCRAPING

upwork.com 🟢 2026-05-06

🔹 Automated PDF Download from Search Queries
👤 Client: 🇺🇸 United States Member since 2021-06-03
💰 Price: ****
🚩 Problem: Need to automate downloading of 2 PDFs per search query for 33k searches within 24 hours.
📦 Existing: Not specified

Specifications:

[Target] - Define search parameters and URLs for the site to be scraped.
[Method] - Implement a script or bot to perform automated searches, download up to two PDFs per query, and save them locally or in a cloud storage service.
[UI/UX] - Not applicable as this is a backend task.
[Stack] - Python with libraries like Selenium or Scrapy for web scraping, requests for HTTP requests, and pandas for data handling. Cloud storage integration if required.
[Security] - Ensure compliance with the site's terms of service; use proxies to avoid IP bans. Implement error handling and logging.
[Format] - Output should be a structured JSON file containing search queries, URLs of downloaded PDFs, and any relevant metadata.

Workflow:

Define search parameters and target URL(s).
Develop the scraping script with error handling and logging.
Test the script on a small subset to ensure it works as expected.
Scale up to full dataset (33k searches) ensuring performance and compliance.
Deploy and monitor the process for 24 hours.